Papers with neural response generation
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation (2022.acl-long)
Copied to clipboard
Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia, Seokhwan Kim, Jay Pujara, Xiang Ren, Yang Liu, Dilek Hakkani-Tur
| Challenge: | Current neural response generation models generate responses directly, omitting unstated implicit knowledge. |
| Approach: | They propose a generative approach to externalize implicit commonsense knowledge and use it to generate responses. |
| Outcome: | Empirical results show that TBS models outperform end-to-end RG models on most automatic metrics and generate more informative, specific, and commonsense-following responses. |
Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention (P19-1)
Copied to clipboard
| Challenge: | Existing models for limited-domain RNNs are difficult to scale due to the complexity of the inputs. |
| Approach: | They propose to use dialog acts to build a multi-layer hierarchical graph with a disentangled self-attention network. |
| Outcome: | The proposed model improves on the baselines on automatic and human evaluation metrics. |
Retrieval-Enhanced Adversarial Training for Neural Response Generation (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to dialogue systems are labor-intensive and difficult to scale up. |
| Approach: | They propose a Retrieval-Enhanced Adversarial Training method for neural response generation that leverages an adversarial training paradigm while taking advantage of N-best response candidates from a retrieval-based system to construct the discriminator. |
| Outcome: | The proposed method outperforms the vanilla Seq2Seq model and conventional adversarial training approach on a large scale dataset. |
A Taxonomy of Empathetic Response Intents in Human Social Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Open-domain conversational agents or chatbots are becoming increasingly popular in the natural language processing community. |
| Approach: | They aim to combine dialogue act/intent modelling and neural response generation to produce a large-scale taxonomy for empathetic response intents. |
| Outcome: | The proposed method improves the response quality of chatbots and makes them more controllable and interpretable. |